Pandas Profiling Report

Dataset statistics

Number of variables	22
Number of observations	89
Missing cells	285
Missing cells (%)	14.6%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	15.4 KiB
Average record size in memory	177.4 B

Variable types

NUM	13
CAT	7
UNSUPPORTED	1
BOOL	1

Warnings

`lpep_pickup_datetime` has constant value "89"	Constant
`level_1` has a high cardinality: 88 distinct values	High cardinality
`VendorID` has a high cardinality: 88 distinct values	High cardinality
`MTA_tax` is highly correlated with `Pickup_longitude`	High correlation
`Pickup_longitude` is highly correlated with `MTA_tax`	High correlation
`Tip_amount` is highly correlated with `Pickup_latitude` and 1 other fields	High correlation
`Pickup_latitude` is highly correlated with `Tip_amount`	High correlation
`Dropoff_longitude` is highly correlated with `Tip_amount`	High correlation
`Payment_type` is highly correlated with `Lpep_dropoff_datetime` and 2 other fields	High correlation
`Lpep_dropoff_datetime` is highly correlated with `Payment_type`	High correlation
`Fare_amount` is highly correlated with `Payment_type`	High correlation
`Tolls_amount` is highly correlated with `Payment_type`	High correlation
`VendorID` is highly correlated with `level_1`	High correlation
`level_1` is highly correlated with `VendorID`	High correlation
`Payment_type` is highly correlated with `Lpep_dropoff_datetime`	High correlation
`Lpep_dropoff_datetime` is highly correlated with `Payment_type`	High correlation
`Extra` has 66 (74.2%) missing values	Missing
`Tip_amount` has 23 (25.8%) missing values	Missing
`Total_amount` has 36 (40.4%) missing values	Missing
`Payment_type` has 71 (79.8%) missing values	Missing
`Trip_type` has 89 (100.0%) missing values	Missing
`level_1` is uniformly distributed	Uniform
`VendorID` is uniformly distributed	Uniform
`Trip_type` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`Store_and_fwd_flag` has 4 (4.5%) zeros	Zeros
`RateCodeID` has 4 (4.5%) zeros	Zeros
`Pickup_longitude` has 1 (1.1%) zeros	Zeros
`Pickup_latitude` has 14 (15.7%) zeros	Zeros
`Dropoff_latitude` has 13 (14.6%) zeros	Zeros
`Passenger_count` has 3 (3.4%) zeros	Zeros
`Trip_distance` has 47 (52.8%) zeros	Zeros
`Extra` has 15 (16.9%) zeros	Zeros
`Tolls_amount` has 5 (5.6%) zeros	Zeros
`Total_amount` has 27 (30.3%) zeros	Zeros

Reproduction

Analysis started	2020-12-31 01:52:16.830065
Analysis finished	2020-12-31 01:52:36.164247
Duration	19.33 seconds
Software version	pandas-profiling v2.9.0
Download configuration	config.yaml

level_0
Categorical

Distinct	2
Distinct (%)	2.2%
Missing	0
Missing (%)	0.0%
Memory size	712.0 B

2	84
1	5

Frequencies
Length

Value	Count	Frequency (%)
2	84	94.4%
1	5	5.6%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

level_1
Categorical

HIGH CARDINALITY
HIGH CORRELATION
UNIFORM

Distinct	88
Distinct (%)	98.9%
Missing	0
Missing (%)	0.0%
Memory size	712.0 B

2015-11-01 00:57:34	2
2015-08-01 00:01:57	1
2019-09-01 00:10:53	1
2019-10-01 00:26:02	1
2015-07-01 00:01:10	1
Other values (83)	83

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
2015-11-01 00:57:34	2	2.2%
2015-08-01 00:01:57	1	1.1%
2019-09-01 00:10:53	1	1.1%
2019-10-01 00:26:02	1	1.1%
2015-07-01 00:01:10	1	1.1%
2019-08-01 00:22:12	1	1.1%
2018-12-01 00:23:25	1	1.1%
2020-02-01 00:16:59	1	1.1%
2013-10-01 00:00:00	1	1.1%
2020-06-01 00:09:05	1	1.1%
Other values (78)	78	87.6%

Frequencies of value counts

Unique

Unique	87 ?
Unique (%)	97.8%

Histogram of lengths of the category

Length

Max length	19
Median length	19
Mean length	19
Min length	19

VendorID
Categorical

HIGH CARDINALITY
HIGH CORRELATION
UNIFORM

Distinct	88
Distinct (%)	98.9%
Missing	0
Missing (%)	0.0%
Memory size	712.0 B

2015-11-01 23:57:45	2
2018-03-01 00:22:02	1
2020-05-01 00:44:00	1
2015-10-01 00:56:03	1
2016-02-01 00:10:06	1
Other values (83)	83

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
2015-11-01 23:57:45	2	2.2%
2018-03-01 00:22:02	1	1.1%
2020-05-01 00:44:00	1	1.1%
2015-10-01 00:56:03	1	1.1%
2016-02-01 00:10:06	1	1.1%
2019-07-01 00:29:50	1	1.1%
2017-12-01 00:40:22	1	1.1%
2016-01-01 00:39:36	1	1.1%
2017-06-01 01:39:52	1	1.1%
2016-11-01 00:50:48	1	1.1%
Other values (78)	78	87.6%

Frequencies of value counts

Unique

Unique	87 ?
Unique (%)	97.8%

Histogram of lengths of the category

Length

Max length	19
Median length	19
Mean length	19
Min length	19

lpep_pickup_datetime
Categorical

CONSTANT
REJECTED

Distinct	1
Distinct (%)	1.1%
Missing	0
Missing (%)	0.0%
Memory size	712.0 B

N	89

Frequencies
Length

Value	Count	Frequency (%)
N	89	100.0%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Lpep_dropoff_datetime
Categorical

HIGH CORRELATION
HIGH CORRELATION

Distinct	4
Distinct (%)	4.5%
Missing	0
Missing (%)	0.0%
Memory size	712.0 B

1	80
5	7
4	1
2	1

Frequencies
Length

Value	Count	Frequency (%)
1	80	89.9%
5	7	7.9%
4	1	1.1%
2	1	1.1%

Frequencies of value counts

Unique

Unique	2 ?
Unique (%)	2.2%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Store_and_fwd_flag
Real number (ℝ)

ZEROS

Distinct	50
Distinct (%)	56.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	75.06999729
Minimum	-74.01079559
Maximum	264
Zeros	4
Zeros (%)	4.5%
Memory size	712.0 B

Quantile statistics

Minimum	-74.01079559
5-th percentile	-73.96972504
Q1	0
median	74
Q3	145
95-th percentile	260.8
Maximum	264
Range	338.0107956
Interquartile range (IQR)	145

Descriptive statistics

Standard deviation	108.5105896
Coefficient of variation (CV)	1.445458818
Kurtosis	-0.8953076846
Mean	75.06999729
Median Absolute Deviation (MAD)	71
Skewness	0.2284766632
Sum	6681.229759
Variance	11774.54805
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
264	5	5.6%
66	5	5.6%
255	4	4.5%
74	4	4.5%
92	4	4.5%
193	4	4.5%
97	4	4.5%
0	4	4.5%
42	3	3.4%
80	3	3.4%
Other values (40)	49	55.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-74.01079559	1	1.1%
-73.99118042	1	1.1%
-73.98764038	1	1.1%
-73.98733521	1	1.1%
-73.97948456	1	1.1%

Value	Count	Frequency (%)
264	5	5.6%
256	1	1.1%
255	4	4.5%
244	2	2.2%
236	1	1.1%

RateCodeID
Real number (ℝ_≥0)

ZEROS

Distinct	62
Distinct (%)	69.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	109.573833
Minimum	0
Maximum	265
Zeros	4
Zeros (%)	4.5%
Memory size	712.0 B

Quantile statistics

Minimum	0
5-th percentile	9.4
Q1	40.72150803
median	74
Q3	192
95-th percentile	263
Maximum	265
Range	265
Interquartile range (IQR)	151.278492

Descriptive statistics

Standard deviation	85.47290806
Coefficient of variation (CV)	0.7800485364
Kurtosis	-1.164983209
Mean	109.573833
Median Absolute Deviation (MAD)	55
Skewness	0.5436935547
Sum	9752.071136
Variance	7305.618012
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
193	6	6.7%
0	4	4.5%
41	4	4.5%
264	3	3.4%
256	3	3.4%
49	3	3.4%
145	2	2.2%
129	2	2.2%
97	2	2.2%
14	2	2.2%
Other values (52)	58	65.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	4	4.5%
7	1	1.1%
13	1	1.1%
14	2	2.2%
17	1	1.1%

Value	Count	Frequency (%)
265	1	1.1%
264	3	3.4%
263	2	2.2%
256	3	3.4%
247	1	1.1%

Pickup_longitude
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	25
Distinct (%)	28.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	-16.92781616
Minimum	-74.01078033
Maximum	5
Zeros	1
Zeros (%)	1.1%
Memory size	712.0 B

Quantile statistics

Minimum	-74.01078033
5-th percentile	-73.98213654
Q1	0
median	1
Q3	1
95-th percentile	5
Maximum	5
Range	79.01078033
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	32.87896324
Coefficient of variation (CV)	-1.942303894
Kurtosis	-0.5968203748
Mean	-16.92781616
Median Absolute Deviation (MAD)	0
Skewness	-1.186332462
Sum	-1506.575638
Variance	1081.026224
Monotocity	Not monotonic

Histogram with fixed size bins (bins=25)

Value	Count	Frequency (%)
1	48	53.9%
5	12	13.5%
2	6	6.7%
-73.95898438	2	2.2%
-73.86499023	1	1.1%
-74.00005341	1	1.1%
-73.9841156	1	1.1%
-73.92427826	1	1.1%
-73.97253418	1	1.1%
-73.95726013	1	1.1%
Other values (15)	15	16.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-74.01078033	1	1.1%
-74.00005341	1	1.1%
-73.98732758	1	1.1%
-73.9841156	1	1.1%
-73.98394012	1	1.1%

Value	Count	Frequency (%)
5	12	13.5%
2	6	6.7%
1	48	53.9%
0	1	1.1%
-73.83633423	1	1.1%

Pickup_latitude
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	72
Distinct (%)	80.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	12.7542269
Minimum	0
Maximum	90.41
Zeros	14
Zeros (%)	15.7%
Memory size	712.0 B

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0.76
median	2.8
Q3	40.66344833
95-th percentile	40.81643906
Maximum	90.41
Range	90.41
Interquartile range (IQR)	39.90344833

Descriptive statistics

Standard deviation	18.7378246
Coefficient of variation (CV)	1.469146248
Kurtosis	1.915168236
Mean	12.7542269
Median Absolute Deviation (MAD)	2.67
Skewness	1.527077381
Sum	1135.126194
Variance	351.1060707
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	14	15.7%
0.76	2	2.2%
0.72	2	2.2%
1.5	2	2.2%
40.66344833	2	2.2%
40.78588486	1	1.1%
40.72904587	1	1.1%
40.76037979	1	1.1%
40.69804382	1	1.1%
40.76064682	1	1.1%
Other values (62)	62	69.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	14	15.7%
0.24	1	1.1%
0.51	1	1.1%
0.58	1	1.1%
0.67	1	1.1%

Value	Count	Frequency (%)
90.41	1	1.1%
40.91221237	1	1.1%
40.84508896	1	1.1%
40.8260994	1	1.1%
40.8189888	1	1.1%

Dropoff_longitude
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	38
Distinct (%)	42.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	12.67640449
Minimum	1
Maximum	404.5
Zeros	0
Zeros (%)	0.0%
Memory size	712.0 B

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2.5
median	6
Q3	12.5
95-th percentile	25.5
Maximum	404.5
Range	403.5
Interquartile range (IQR)	10

Descriptive statistics

Standard deviation	42.64503601
Coefficient of variation (CV)	3.364127109
Kurtosis	83.59811148
Mean	12.67640449
Median Absolute Deviation (MAD)	5
Skewness	9.011845796
Sum	1128.2
Variance	1818.599096
Monotocity	Not monotonic

Histogram with fixed size bins (bins=38)

Value	Count	Frequency (%)
1	19	21.3%
5	6	6.7%
2.5	5	5.6%
6	5	5.6%
3.5	3	3.4%
20	3	3.4%
13.5	3	3.4%
3	3	3.4%
9	3	3.4%
11	3	3.4%
Other values (28)	36	40.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	19	21.3%
1.5	1	1.1%
2	1	1.1%
2.5	5	5.6%
3	3	3.4%

Value	Count	Frequency (%)
404.5	1	1.1%
28.2	1	1.1%
28	1	1.1%
27.5	1	1.1%
26.5	1	1.1%

Dropoff_latitude
Real number (ℝ_≥0)

ZEROS

Distinct	20
Distinct (%)	22.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.9204494382
Minimum	0
Maximum	14.35
Zeros	13
Zeros (%)	14.6%
Memory size	712.0 B

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0.5
median	0.5
Q3	0.5
95-th percentile	3.828
Maximum	14.35
Range	14.35
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	1.814723815
Coefficient of variation (CV)	1.971562738
Kurtosis	34.96111593
Mean	0.9204494382
Median Absolute Deviation (MAD)	0
Skewness	5.323121676
Sum	81.92
Variance	3.293222523
Monotocity	Not monotonic

Histogram with fixed size bins (bins=20)

Value	Count	Frequency (%)
0.5	57	64.0%
0	13	14.6%
0.09	2	2.2%
0.2	1	1.1%
4	1	1.1%
3.25	1	1.1%
5.24	1	1.1%
6.11	1	1.1%
3.57	1	1.1%
0.19	1	1.1%
Other values (10)	10	11.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	13	14.6%
0.09	2	2.2%
0.19	1	1.1%
0.2	1	1.1%
0.49	1	1.1%

Value	Count	Frequency (%)
14.35	1	1.1%
6.11	1	1.1%
5.24	1	1.1%
4.33	1	1.1%
4	1	1.1%

Passenger_count
Real number (ℝ)

ZEROS

Distinct	23
Distinct (%)	25.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	4.478089888
Minimum	-15
Maximum	52
Zeros	3
Zeros (%)	3.4%
Memory size	712.0 B

Quantile statistics

Minimum	-15
5-th percentile	0.5
Q1	0.5
median	0.5
Q3	0.5
95-th percentile	20.55
Maximum	52
Range	67
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	10.69723296
Coefficient of variation (CV)	2.38879371
Kurtosis	10.48827477
Mean	4.478089888
Median Absolute Deviation (MAD)	0
Skewness	3.111339855
Sum	398.55
Variance	114.4307929
Monotocity	Not monotonic

Histogram with fixed size bins (bins=23)

Value	Count	Frequency (%)
0.5	63	70.8%
0	3	3.4%
3.5	2	2.2%
12.5	2	2.2%
7.8	1	1.1%
45	1	1.1%
50.5	1	1.1%
42	1	1.1%
13	1	1.1%
15.5	1	1.1%
Other values (13)	13	14.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-15	1	1.1%
0	3	3.4%
0.5	63	70.8%
3.5	2	2.2%
5	1	1.1%

Value	Count	Frequency (%)
52	1	1.1%
50.5	1	1.1%
45	1	1.1%
42	1	1.1%
21.25	1	1.1%

Trip_distance
Real number (ℝ_≥0)

ZEROS

Distinct	27
Distinct (%)	30.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.9943820225
Minimum	0
Maximum	7.64
Zeros	47
Zeros (%)	52.8%
Memory size	712.0 B

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	1.26
95-th percentile	4.44
Maximum	7.64
Range	7.64
Interquartile range (IQR)	1.26

Descriptive statistics

Standard deviation	1.649629404
Coefficient of variation (CV)	1.658949344
Kurtosis	3.4868427
Mean	0.9943820225
Median Absolute Deviation (MAD)	0
Skewness	1.964365544
Sum	88.5
Variance	2.721277171
Monotocity	Not monotonic

Histogram with fixed size bins (bins=27)

Value	Count	Frequency (%)
0	47	52.8%
0.5	13	14.6%
1	4	4.5%
4.44	2	2.2%
2.04	1	1.1%
2.5	1	1.1%
3	1	1.1%
2.56	1	1.1%
5.76	1	1.1%
3.11	1	1.1%
Other values (17)	17	19.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	47	52.8%
0.01	1	1.1%
0.5	13	14.6%
0.7	1	1.1%
1	4	4.5%

Value	Count	Frequency (%)
7.64	1	1.1%
6.03	1	1.1%
5.76	1	1.1%
4.76	1	1.1%
4.44	2	2.2%

Fare_amount
Categorical

HIGH CORRELATION

Distinct	4
Distinct (%)	4.5%
Missing	0
Missing (%)	0.0%
Memory size	712.0 B

0	69
0.5	17
6.12	2
5.76	1

Frequencies
Length

Value	Count	Frequency (%)
0	69	77.5%
0.5	17	19.1%
6.12	2	2.2%
5.76	1	1.1%

Frequencies of value counts

Unique

Unique	1 ?
Unique (%)	1.1%

Histogram of lengths of the category

Length

Max length	4
Median length	3
Mean length	3.033707865
Min length	3

Extra
Real number (ℝ_≥0)

MISSING
ZEROS

Distinct	9
Distinct (%)	39.1%
Missing	66
Missing (%)	74.2%
Infinite	0
Infinite (%)	0.0%

Mean	1.218695652
Minimum	0
Maximum	10.3
Zeros	15
Zeros (%)	16.9%
Memory size	712.0 B

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	1.71
95-th percentile	5.902
Maximum	10.3
Range	10.3
Interquartile range (IQR)	1.71

Descriptive statistics

Standard deviation	2.471018017
Coefficient of variation (CV)	2.027592379
Kurtosis	8.525754497
Mean	1.218695652
Median Absolute Deviation (MAD)	0
Skewness	2.817782614
Sum	28.03
Variance	6.10593004
Monotocity	Not monotonic

Histogram with fixed size bins (bins=9)

Value	Count	Frequency (%)
0	15	16.9%
10.3	1	1.1%
1.26	1	1.1%
2.86	1	1.1%
1.95	1	1.1%
1.56	1	1.1%
6.24	1	1.1%
1.86	1	1.1%
2	1	1.1%
(Missing)	66	74.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	15	16.9%
1.26	1	1.1%
1.56	1	1.1%
1.86	1	1.1%
1.95	1	1.1%

Value	Count	Frequency (%)
10.3	1	1.1%
6.24	1	1.1%
2.86	1	1.1%
2	1	1.1%
1.95	1	1.1%

MTA_tax
Boolean

HIGH CORRELATION

Distinct	2
Distinct (%)	2.2%
Missing	0
Missing (%)	0.0%
Memory size	712.0 B

0.3	64
0	25

Common Values
Chart

Value	Count	Frequency (%)
0.3	64	71.9%
0	25	28.1%

Tip_amount
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	52
Distinct (%)	78.8%
Missing	23
Missing (%)	25.8%
Infinite	0
Infinite (%)	0.0%

Mean	19.6219697
Minimum	1.7
Maximum	413.51
Zeros	0
Zeros (%)	0.0%
Memory size	712.0 B

Quantile statistics

Minimum	1.7
5-th percentile	3.8
Q1	7.3
median	10.13
Q3	19.24
95-th percentile	34.4625
Maximum	413.51
Range	411.81
Interquartile range (IQR)	11.94

Descriptive statistics

Standard deviation	50.05578864
Coefficient of variation (CV)	2.551007336
Kurtosis	61.55362179
Mean	19.6219697
Median Absolute Deviation (MAD)	5.285
Skewness	7.722510339
Sum	1295.05
Variance	2505.581976
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
7.3	4	4.5%
3.8	4	4.5%
7.8	3	3.4%
4.3	3	3.4%
19.24	2	2.2%
13.3	2	2.2%
12.3	2	2.2%
5.8	2	2.2%
14.3	1	1.1%
6.24	1	1.1%
Other values (42)	42	47.2%
(Missing)	23	25.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1.7	1	1.1%
3.3	1	1.1%
3.8	4	4.5%
4.3	3	3.4%
4.8	1	1.1%

Value	Count	Frequency (%)
413.51	1	1.1%
38.19	1	1.1%
36.2	1	1.1%
34.56	1	1.1%
34.17	1	1.1%

Tolls_amount
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	9
Distinct (%)	10.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2.701685393
Minimum	0
Maximum	61.8
Zeros	5
Zeros (%)	5.6%
Memory size	712.0 B

Quantile statistics

Minimum	0
5-th percentile	0.12
Q1	1
median	1
Q3	2
95-th percentile	3.2
Maximum	61.8
Range	61.8
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	8.109760006
Coefficient of variation (CV)	3.001741071
Kurtosis	38.64100191
Mean	2.701685393
Median Absolute Deviation (MAD)	0.7
Skewness	6.032733735
Sum	240.45
Variance	65.76820735
Monotocity	Not monotonic

Histogram with fixed size bins (bins=9)

Value	Count	Frequency (%)
1	39	43.8%
2	27	30.3%
0.3	13	14.6%
0	5	5.6%
61.8	1	1.1%
14	1	1.1%
4	1	1.1%
42.5	1	1.1%
21.25	1	1.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	5	5.6%
0.3	13	14.6%
1	39	43.8%
2	27	30.3%
4	1	1.1%

Value	Count	Frequency (%)
61.8	1	1.1%
42.5	1	1.1%
21.25	1	1.1%
14	1	1.1%
4	1	1.1%

Ehail_fee
Real number (ℝ)

Distinct	20
Distinct (%)	22.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	3.91494382
Minimum	-15
Maximum	52.8
Zeros	0
Zeros (%)	0.0%
Memory size	712.0 B

Quantile statistics

Minimum	-15
5-th percentile	1
Q1	1
median	1
Q3	2
95-th percentile	17.016
Maximum	52.8
Range	67.8
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	8.67607383
Coefficient of variation (CV)	2.216142614
Kurtosis	16.51451812
Mean	3.91494382
Median Absolute Deviation (MAD)	0
Skewness	3.608597201
Sum	348.43
Variance	75.2742571
Monotocity	Not monotonic

Histogram with fixed size bins (bins=20)

Value	Count	Frequency (%)
1	65	73.0%
2	6	6.7%
8.8	1	1.1%
7	1	1.1%
9.75	1	1.1%
45	1	1.1%
15	1	1.1%
-15	1	1.1%
11.8	1	1.1%
9.36	1	1.1%
Other values (10)	10	11.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-15	1	1.1%
1	65	73.0%
2	6	6.7%
4.8	1	1.1%
7	1	1.1%

Value	Count	Frequency (%)
52.8	1	1.1%
45	1	1.1%
27.04	1	1.1%
19.3	1	1.1%
17.16	1	1.1%

Total_amount
Real number (ℝ_≥0)

MISSING
ZEROS

Distinct	5
Distinct (%)	9.4%
Missing	36
Missing (%)	40.4%
Infinite	0
Infinite (%)	0.0%

Mean	0.8726415094
Minimum	0
Maximum	3
Zeros	27
Zeros (%)	30.3%
Memory size	712.0 B

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	2
95-th percentile	2.75
Maximum	3
Range	3
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	1.05226706
Coefficient of variation (CV)	1.205841171
Kurtosis	-0.843539169
Mean	0.8726415094
Median Absolute Deviation (MAD)	0
Skewness	0.7997158501
Sum	46.25
Variance	1.107265965
Monotocity	Not monotonic

Histogram with fixed size bins (bins=5)

Value	Count	Frequency (%)
0	27	30.3%
1	12	13.5%
2.75	7	7.9%
2	6	6.7%
3	1	1.1%
(Missing)	36	40.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	27	30.3%
1	12	13.5%
2	6	6.7%
2.75	7	7.9%
3	1	1.1%

Value	Count	Frequency (%)
3	1	1.1%
2.75	7	7.9%
2	6	6.7%
1	12	13.5%
0	27	30.3%

Payment_type
Categorical

HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	2
Distinct (%)	11.1%
Missing	71
Missing (%)	79.8%
Memory size	712.0 B

1	13
2	5

Frequencies
Length

Value	Count	Frequency (%)
1	13	14.6%
2	5	5.6%
(Missing)	71	79.8%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	3
Median length	3
Mean length	3
Min length	3

Trip_type
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing	89
Missing (%)	100.0%
Memory size	840.0 B

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

First rows

	level_0	level_1	VendorID	lpep_pickup_datetime	Lpep_dropoff_datetime	Store_and_fwd_flag	RateCodeID	Pickup_longitude	Pickup_latitude	Dropoff_longitude	Dropoff_latitude	Passenger_count	Trip_distance	Fare_amount	Extra	Tip_amount	Tolls_amount	Ehail_fee	Total_amount	Payment_type	Trip_type
0	2	2013-08-01 08:14:37	2013-08-01 09:09:06	N	1	0.000000	0.000000	0.000000	0.000000	1.0	0.00	21.25	0.0	0.0	0.00	NaN	21.25	2.00	NaN	NaN	NaN
1	2	2013-09-01 00:02:00	2013-09-01 00:54:51	N	1	-73.952408	40.810726	-73.983940	40.676285	5.0	14.35	50.50	0.5	0.5	10.30	NaN	61.80	1.00	NaN	NaN	NaN
2	2	2013-10-01 00:00:00	2013-10-01 15:33:36	N	1	0.000000	0.000000	-73.903465	40.845089	1.0	0.19	42.00	0.0	0.5	0.00	NaN	42.50	2.00	1.0	NaN	NaN
3	2	2013-11-01 00:00:00	2013-11-01 13:48:03	N	1	0.000000	0.000000	-73.937103	40.760647	2.0	0.00	3.50	0.0	0.5	0.00	NaN	4.00	2.00	NaN	NaN	NaN
4	2	2013-12-01 00:00:00	2013-12-01 20:44:23	N	1	0.000000	0.000000	-73.957260	40.742355	1.0	4.00	13.00	0.5	0.5	0.00	NaN	14.00	2.00	NaN	NaN	NaN
5	2	2015-07-01 00:01:10	2015-07-01 00:19:04	N	1	-73.940628	40.715027	-73.912315	40.760380	1.0	4.33	15.50	0.5	0.5	0.00	NaN	0.30	16.80	2.0	1.0	NaN
6	2	2015-07-01 00:05:35	2015-07-01 00:17:42	N	1	-73.951134	40.804947	-73.867218	40.818989	1.0	6.11	18.00	0.5	0.5	0.00	NaN	0.30	19.30	1.0	1.0	NaN
7	2	2015-08-01 00:00:03	2015-08-01 00:00:07	N	5	-73.865013	40.826099	-73.864990	40.826099	1.0	0.00	7.00	0.0	0.0	0.00	NaN	0.00	7.00	1.0	2.0	NaN
8	2	2015-08-01 00:01:57	2015-08-01 00:02:00	N	2	-73.987335	40.692123	-73.987328	40.692123	1.0	0.00	52.00	0.0	0.5	0.00	NaN	0.30	52.80	2.0	1.0	NaN
9	2	2015-09-01 00:02:34	2015-09-01 00:02:38	N	5	-73.979485	40.684956	-73.979431	40.685020	1.0	0.00	7.80	0.0	0.0	1.95	NaN	0.00	9.75	1.0	2.0	NaN

Last rows

	level_0	level_1	VendorID	lpep_pickup_datetime	Lpep_dropoff_datetime	Store_and_fwd_flag	RateCodeID	Pickup_longitude	Pickup_latitude	Dropoff_longitude	Dropoff_latitude	Passenger_count	Trip_distance	Extra	MTA_tax	Tip_amount	Tolls_amount	Ehail_fee	Total_amount	Payment_type	Trip_type
79	2	2020-02-01 00:10:25	2020-02-01 00:14:34	N	1	74.0	41.0	1.0	0.76	4.5	0.5	0.5	0.00	NaN	0.3	5.80	2.0	1.0	0.00	NaN	NaN
80	2	2020-02-01 00:16:59	2020-02-01 00:21:35	N	1	74.0	74.0	1.0	0.72	5.0	0.5	0.5	0.00	NaN	0.3	6.30	1.0	1.0	0.00	NaN	NaN
81	2	2020-03-01 00:20:18	2020-03-01 00:45:29	N	1	41.0	13.0	1.0	8.24	26.5	0.5	0.5	7.64	NaN	0.3	38.19	1.0	1.0	2.75	NaN	NaN
82	2	2020-03-01 00:15:42	2020-03-01 00:44:36	N	1	181.0	107.0	1.0	4.87	21.0	0.5	0.5	0.00	NaN	0.3	25.05	2.0	1.0	2.75	NaN	NaN
83	2	2020-04-01 00:44:02	2020-04-01 00:52:23	N	1	42.0	41.0	1.0	1.68	8.0	0.5	0.5	0.00	NaN	0.3	9.30	1.0	1.0	0.00	NaN	NaN
84	2	2020-04-01 00:24:39	2020-04-01 00:33:06	N	1	244.0	247.0	2.0	1.94	9.0	0.5	0.5	0.00	NaN	0.3	10.30	2.0	1.0	0.00	NaN	NaN
85	2	2020-05-01 00:27:48	2020-05-01 00:32:47	N	1	74.0	42.0	1.0	1.50	6.5	0.5	0.5	0.00	NaN	0.3	7.80	1.0	1.0	0.00	NaN	NaN
86	2	2020-05-01 00:39:13	2020-05-01 00:44:00	N	1	244.0	116.0	2.0	0.92	6.0	0.5	0.5	0.00	NaN	0.3	7.30	2.0	1.0	0.00	NaN	NaN
87	1	2020-06-01 00:22:07	2020-06-01 00:39:03	N	1	255.0	14.0	1.0	0.00	28.2	0.0	0.5	0.00	NaN	0.3	29.00	1.0	1.0	0.00	NaN	NaN
88	2	2020-06-01 00:09:05	2020-06-01 00:22:46	N	1	166.0	141.0	1.0	3.43	13.0	0.5	0.5	3.41	NaN	0.3	20.46	1.0	1.0	2.75	NaN	NaN

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows